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Tliis is an appeal to the Board of Patent Appeals and Interferences from the 
decision of the Examiner of Group 2612, dated March 21, 2005, in which claims 1-20 in 
the above- identified application were finally rejected. This Appeal Brief is hereby 
submitted pursuant to 37 C.F.R. § 41.37(a). 

I. REAL PARTY IN INTEREST 

The real party in interest is the assignee of the full interest in the invention, Sony 
Electronics, Inc., 1 Sony Drive, Park Ridge, New Jersey 07656. 
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11. RELATED APPEALS AND INTERFERENCES 

To the best of Appellant's knowledge, there are no appeals or interferences related 
to the present appeal that will directly affect, be directly affected by, or have a bearing on 
the Board's decision in the instant appeal. 

IIL STATUS OF THE CLAIMS 

Claims 1-20 are pending in the application and were finally rejected in an Office 
Action mailed March 21, 2005. Claims 1-20 are the subject of this appeal. A copy of 
Claims 1-20 as they stand on appeal are set forth in Appendix A. 

IV. STATUS OF AMENDMENTS 

No amendments to the claims have been made after receipt of the Final Office 

Action. 



V. SUMMARY OF CLAIMED SUBJECT MATTER 

Appellant's invention as claimed in claims 1-20 is directed to capturing a raw 
image and providing edge enhancements to increase edge detail to the capture raw image 
as part of a demosaicing process [Specification: Page 9, Line 17 - Page 10, Line 10; 
Figure 3] A brightness map of the captured raw image is used for providing the edge 
enhancements. [Specification: Page 10, Line 22 - Page 11, Line 20; Figure 5] 
Furthermore, the edge of the captured raw image is detected using the brightness map, a 
mask image is created from edge detected brightness map, and an unsharp edge 
enhancement is performed on the mask image. [Specification: Page 11, Line 21 - Page 
12, Line 19; Figure 5] 

VI. GROUNDS OF REJECTION TO BE REVIEWED ON APPEAL 

I. Claims 1-15 stand rejected under 35 U.S.C. § 103(a) over U.S. Patent No. 
6.404,918 to Hel-or et al. in view of Kimmel (IEEE Transactions on Image Processing, 
Col. 8, No, 9) and U.S. Patent No. 5,717,781 to Ebel et al. 

II. Claims 16-20 stand rejected under 35 U.S.C. § 103(a) over Hel-or et al. in 
view of Kimmel, Ebel et al., and U.S. Patent No. 6,288,743 to Lathrop et al. 

09/696,436 -2- 80398.P350 



VII. ARGUMENTS 

1. Claims 1-15 are Patentable under 35 U.S,C. § 103(a) over Hel-or et al in view of 
Kimmel and Ebel et al. 

Hel-or discloses a demosaicing method for generating a full color image from a 
partially sampled image. During the demosaicing process, the luminance image 
component is directionally smoothed along image edges to preserve edge detail. Thus, 
Hel-or discloses preserving edge detail during the demosaicing process. 

Kimmel discloses reconstructing a digital image by first demosaicing and then 
enhancing the resulting image. The demosaicing step reconstructs the image using an 
edge- weighted interpolation, so as to avoid interpolating across edges and preserving 
edge detail. The enhancement step enhances the edges of the reconstructed image by 
inverting the color diffusion across the edge. 

Ebel discloses analyzing an image of a contact lens to determine quality of 
contact lens. A CCD sensor captures the image and an image processing system corrects 
the image for known defects in the CCD sensor. The system enhances the edge detail of 
the lens in the corrected image using an edge enhancement operator. In addition, the 
system partitions the image into five zones so that the proper directional edge operator is 
chosen. The system analyzes the lens quality based on the enhanced, corrected image. 

A, Claims i, 2, 6y 7, lly 12 

Claims 1, 2, 6, 7, 11, and 12 stand or fall together. Claim 1 is the representative 
claim. The invention claimed in claim 1 captures a raw image and performs edge 
enhancements to increase edge detail on the raw image as part of a demosaicing process. 

Appellant respectfully submits that the combination of Hel-or, Kimmel and Ebel 
does not teach or suggest each and every element of claim 1. In claim 1, Appellant claims 
providing edge enhancements to increase edge detail of a captured raw image as part of a 
demosaicing process. The Examiner admits that Hel-or does not teach or suggest this 
claim limitation and relies on Kimmel and Ebel as disclosing the missing element. 
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However, because Kimmel discloses providing edge enhancements to the 
reconstructed image after the demosaicing step, Kimmel cannot be properly interpreted as 
disclosing increasing edge detail of the raw image as part of a demosaicing process. 
Furthermore, because Ebel does not disclose a demosaicing process, Ebel cannot teach or 
suggest an increase to edge detail of the raw image as part of a demosaicing process. 

In addition, Appellant respectfully submits that it would not be obvious to 
combine Hel-or, Kimmel, and Ebel. "A prior art must be considered in its entirety, i.e. as 
a whole, including portions that would lead away from the claimed invention." MPEP 
2141.02. Hel-or discloses preserving edge detail whereas Kimmel and Ebel disclose 
enhancing edge detail. Thus, Hel-or actually teaches away from Kimmel and Ebel. 
Therefore, it would not be obvious to combine Hel-or with Kimmel and Ebel. 

Because none of Hel-or, Kimmel, or Ebel teach or suggest providing edge 
enhancements to increase edge detail of a captured raw image as part of a demosaicing 
process as claimed in claim 1, the combination cannot be properly interpreted as 
disclosing this claimed element. Therefore, the combination cannot render obvious 
Appellant's invention as claimed in claim 1. Accordingly, Appellant respectfully requests 
the withdrawal of the rejection of claims 1, 2, 6, 7, 11, and 12 under 35 U.S.C. § 103(a) 
over the combination. 

B. Claims 3, 8, 13 

Claims 3, 8, and 13 stand or fall together. Claim 3 is the representative claim. 
Claim 3 depends on claim 1 and creates a brightness map of the capture raw image as 
part of the edge enhancement process of claim 1 . 

Appellant respectively submits that the combination of Hel-or, Kimmel, and Ebel 
does not teach or suggest creating a brightness map of the captured raw image as claimed. 
The Examiner asserts Hel-or creates a brightness map because Hel-or separates the 
reconstructed image into luminance and chrominance bands. However, this process of 
Hel-or operates on the reconstructed image, not the captured raw image as claimed. 
Furthermore, neither Kimmel nor Ebel teach or suggest creating a brightness map of the 
captured raw image as claimed. 
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Because none of Hel-or, Kimmel, or Ebel, teach or suggest this claimed 
limitation, the combination cannot be properly interpreted as rendering obvious 
Appellant's claim 3. Accordingly, Appellant respectfully requests the withdrawal of the 
rejection of claims 3, 8, 13 under 35 U.S.C. § 103(a) over the combination. 

C. Claims 4, 5, P, 10^ 14, 15 

Claims 4, 5, 9, 10, 14 and 15 stand or fall together. Claim 4 is the representative 
claim. Claim 4 depends from claim 3. Claim 4 further defines the edge enhancement 
process by detecting the edges of the captured raw image, creating a mask image from the 
edge detected brightness map, and performing unsharp edge enhancements on the masked 
image. 

In claim 4, Appellant claims creating a mask image from the edge detected 
brightness map. The Examiner asserts that Ebel discloses this claimed element by 
creating a mask image through partitioning the image into five zones. However, the 
disclosure of Ebel cited by the Examiner discloses partitioning the image so that proper 
directional edge operator is applied, and does not create a mask image as claimed. In 
addition, there is no other disclosure in Ebel that teaches or suggests creating a mask 
image as claimed. Furthermore, neither Hel-or nor Kimmel teach or suggest creating a 
mask image from the edge detected brightness map. 

Because none of Hel-or, Kimmel, or Ebel, teach or suggest this claimed 
limitation, the combination cannot be properly interpreted as rendering obvious 
Appellant's claim 4. Accordingly, Appellant respectfully requests the withdrawal of the 
rejection of claims 4, 5, 9, 10, 14 and 15 under 35 U.S.C. § 103(a) over the combination. 

11. Claims 1-15 are Patentable under 35 U.S.C. § 103(a) over Hel-or et al in view of 
Kimmel, Ebel et al., and Lathrop et al. 

Lathrop discloses an electronic still camera that processes raw captured images 
into finished files. The raw captured image is initially processed by a demosaicing step to 
generate a full color image (referred to in Lathrop as a color filter array interpolation). 
The image is subsequently subjected to edge enhancements before being stored in the 
camera's nonvolatile memory. 
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A. Claims 16-20 

Claims 16-20 stand or fall together. Claim 16 is the representative claim. Claim 
16 claims providing edge enhancements to increase edge detail of the captured raw image 
as part of a demosaicing process. 

Appellant respectfully submits that the combination of Hel-or, Kimmel, Ebel, and 
Lathrop does not teach or suggest each and every limitation of Appellant's invention as 
claimed in claim 16. Lathrop applies edge enhancements to a full color image and not the 
raw image as claimed. Thus, Lathrop caimot be properly interpreted as disclosing 
providing edge enhancements to increase edge detail of the captured raw image as part of 
a demosaicing process as claimed. Therefore, none of Hel-or, Kimmel, Ebel, or Lathrop 
teach or suggest this element as claimed. 

Because the combination cannot be interpreted as disclosing the claimed element, 
the combination cannot render obvious Appellant's invention as claimed in claim 16. 
Accordinly, Appellant respectfully requests the withdrawal of the rejection of claims 16- 
20 under 35 U.S.C. § 103(a) over the combination. 

VIIL CONCLUSION 

The combination of Hel-or, Kimmel, and Ebel does not teach each and every 
limitation of Appellant's invention as claimed in claim 1-15. In addition, the combination 
of Hel-or, Kimmel, Ebel, and Lathrop does not teach each and every limitation of 
Appellant's invention as claimed in claims 16-20. Accordingly, Appellant respectfully 
requests the Board reverse the rejections of Claims 1-20 under 35 U.S.C. § § 103(a) and 
direct the Examiner to enter a Notice of Allowance for Claims 1-20. 

Fee for Filing a Brief in Support of Appeal 

Enclosed is a check in the amount of $500.00 to cover the fee for filing a brief in 
support of an appeal as required under 37 C.F.R. §§ 1.17(c) and 41.37(a). 
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Deposit Account Authorization 

Authorization is hereby given to charge our Deposit Account No. 02-2666 for any 
charges that may be due. Furthermore, if an extension is required, then Appellant hereby 
requests such extension. 



Respectfully submitted. 



BLAKELY, SOKOLOFF, TAYLOR 
& ZAFMAN LLP ^ 



-^ric S.Replogle 1/^ 
Agent for Appellant 
Registration No. 52,161 

12400 Wilshire Boulevard 
Seventh Floor 

Los Angeles, CA 90025-1026 
(408) 720-8300 x309 



Dated: 
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APPENDIX A FOR 
APPELLANT'S BRIEF UNDER 37 C.F.R. 41.37(a) 

1. (Previously Presented) An image processing method comprising: 
capturing a raw image; and 

providing edge enhancements to increase edge detail of the captured raw image as 
part of a demosaicing process. 

2. (Previously Presented) The method of claim 1, further comprising: 
performing post demosaicing processing on the captured raw image; and 
outputting the processed image. 
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3. (Previously Presented) The method of claim 1, wherein providing the edge 
enhancements includes: 

creating a brightness map of the captured raw image. 

4. (Previously Presented) The method of claim 3, wherein providing the edge 
enhancements further includes: 

detecting edges of the captured raw image using the brightness map; 
creating a mask image form the edge detected brightness map; and 
performing unsharp edge enhancement from the masked image. 

5. (Original) The method of claim 4, wherein providing the edge enhancements 
further includes: 

blending multiplicatively the unsharp edge enhanced image with the brightness 

map. 

6. (Previously Presented) An apparatus comprising: 

an image capturing device to capture a raw image; and 
a processor to provide edge enhancements to increase edge detail of the captured raw 
image as part of a demosaicing process. 

7. (Previously Presented) The apparatus of claim 6, wherein the processor is to 
perform post demosaicing processing on the captured raw image and to output the 
processed image. 

8. (Previously Presented) The apparatus of claim 6, wherein the processor is to 
create a brightness map of the captured raw image. 

9. (Previously Presented) The apparatus of claim 8, wherein the processor is to 
detect edges of the captured raw image using the brightness map, to create a mask image 
form the edge detected brightness map, and to perform unsharp edge enhancement from 
the masked image. 
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10. (Original) The apparatus of claim 9, wherein the processor is to blend 
multiplicatively the unsharp edge enhanced image with the brightness map. 

^ 11. (Previously Presented) A machine-readable medium that provides instructions, 

which if executed by a processor, cause the processor to perform the operations 

■ 

comprising: 

capturing a raw image; and 

providing edge enhancements to increase edge detail of the captured raw image as 
part of a demosaicing process. 

12. (Previously Presented) The machine-readable medium of claim 11, further 
providing instructions, which if executed by the processor, cause the processor to perform 
the operations comprising: 

performing post demosaicing processing on the captured raw image; and 
outputting the processed image. 

13. (Previously Presented) The machine-readable medium of claim 1 1, further 
providing instructions, which if executed by the processor, cause the processor to perform 
the operations comprising: 

creating a brightness map of the captured raw image. 

14. (Previously Presented) The machine- readable medium of claim 13, further 
providing instructions, which if executed by the processor, cause the processor to perform 
the operations comprising: 

detecting edges of the captured raw image using the brightness map; 
creating a mask image form the edge detected brightness map; and 
performing unsharp edge enhancement from the masked image. 
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15. (Original) The machine-readable medium of claim 14, further providing 
instructions, which if executed by the processor, cause the processor to perform the 
operations comprising: 

blending multiplicatively the unsharp edge enhanced image with the brightness 

map. 

16. (Previously Presented) An image processing device comprising: 
an image capturing unit to capture a raw image; 

a memory device to store the captured raw image; 

an output unit coupled to the memory device; and 
a processor to provide edge enhancements to increase edge detail of the captured raw 
image in the memory device as part of a demosaicing process and to cause the enhanced 
image to be output is to the output unit. 

17. (Original) The image processing device of claim 16, wherein the image capturing 
unit includes a charge-couple device (CCD) array, phototransistors, or photodiodes. 

18. (Original) The image processing device of claim 16, wherein the output unit is a 
display device. 

19. (Previously Presented) The image processing device of claim 18, wherein the 
processor is to perform post demosaicing processing on the captured raw image and to 
cause the image to be output to the display device. 

20. (Original) The image processing device of claim 19, wherein the post 
demosaicing processing is a white balancing processing or a chromatic improvement 
processing. 
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Other fee (specify) 
Other fee (specify) 



SUBTOTAL (4) $ 500.00 



♦Reduced by Basic Filing Fee Paid 



SUBMITTED BY : 
Typed or Printed Nani^: 
Signature 




Date: 



Reg. Number: 52.161 



Telephone Number: 408-720-8300 



Send to: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450 
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Based on Form PTO/SB/17 (12-04) as modified by BLAKELY, SOKOLOFF. TAYLOR & ZAFMAN LLP on 12/13/04 



